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Abstract 


2 Characteriziition of the error associated to satellite rainfall estimates is a necessary 

3 component of deterministic and probabilistic frameworks involving space-bom passive and 

4 active microwave measurements for applications ranging from water budget studies to 

5 forecasting natural ha/iirds related to extreme rainfall events. We focus here on the error 

6 structure of NASA’s Tropical Rainfall Measurement Mission (TRMM) Precipitation Radar 

7 (PR) quantitative precipimtion estimation (QPE) at ground. The problem is addressed by 

8 comparison of PR QPEs with reference values derived from ground-based measurements 

9 using NOAA/NSSL ground radar-based National Mosaic and QPE system (NMQ/Q2). A 

10 preliminary investigation of this subject has been carried out at the PR estimation scale 

1 i (instaniancoiis and 5 km) using a three-month data sample in the southern part of US. The 

1 2 primary contribution of this study is the presentation of die detailed steps required to derive 

13 a trustworthy reference rainfall dataset from Q2 at the PR pixel resolution. It relies on a bias 

14 correction and a radar quality index, both of which provide a basis to filter out the lc»s 

15 trustworthy Q2 values. Several aspects of PR errors arc revealed and quantified including 

16 sensitivity to the processing steps with the reference rainfall, comparisons of rainfall 

17 deleciabilily and rainfall rate distributions, spatial reprcscniativencss of error, and separation 

18 of systematic biases and random errors. The methodology and framework developed herein 

19 applies more generally to rainfall rate estimates from other sensors onboard low-earth 

20 orbiting salelliles such as microwave imagers and dual-wavelength radars such as with the 

21 Global Precipitation Measurement (GPM) mission. 
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Toward a Framework for Systematic Error Moddlng of NASA Spaceborne Radar 



1 Fisher 2008). Ii impacts rain cslimates from po!ar-«rbiling passive microwave measurements 

2 and a numlwr of sat:ellilc-bai»ed high-resolution precipitation products (Ebert e( ai 2007; 

3 Berg^s et ai 2009; Ushio et ai 2006). Given the variety of potential sources of error in PR- 

4 based QPE and the impact of correction algorithms, the only practical solution is to evaluate 

5 PR QPE with respect to an external, independent reference rainfall data set. The reference is 

6 derived from high-resolution ground validation measurements using NOAA/NSSL ground 

7 radar-based National Mosaic and QPE system (NMQ; Zhang et ai 2011). These products 

8 yield instantaneous rainfall rale products over vast regions including regions of the 

9 conieraiinous US covered by NEXRAD data. While a number of studies have investigated 

10 tlie quality of PR estimates in various regions of the world (c.g., Adeyama and Nakamura 

i I 2003; WoitT and Fisher 2008; 2009; Aniitai et ai 2009; 201 1), our aim is to perform a 

12 systematic and comprehensive evaluation for regions over the southern conterminous US 

!3 (CONUS). 

14 We will characterize enors in PR estimates at the pixel measurement scale in order U> 

15 minimize additional uncertainties caused by resampling. Systematic and stochastic errore of 

1 6 PR estimates will be documented in ternis of bias and spatial stniclure. One should note that 

17 it is not possible to “validate" the PR estimates in a strict sense because independent rainfall 

18 estimates with no uncertainty do not exist. Rainfall estimates frorn low-earth orbiting 

19 satellites suffer from their poor temporal sampling (Wolff and Fisher 2008; 2009; Lin and 

20 Hou 2008). Hence representative samples of direct comparisons between instantaneous 

21 coincident measurements from ground and space arc difficult to achieve without a sufficient 

22 number of overpasses. This study uses three months (March-May 201 1) of saicllilc 

23 overpasses over the lower CONUS. The data arc pixel-matched in both time and space, and 

24 statistics arc provided for comparing reference rain intensities to satellite-based cslimates. 


1 

2 1. Introduction 

3 Reliable quantitative information on the spatial distribution of rainfall is essential for 

4 hydrologic and climatic applications, which range from real-time flood forecasting to 

5 evaluation of regional and global atmospheric model simulations. Given tlteir quasi-global 

6 coverage, satellite-based quantitative rainfall estimates are becoming widely used for such 

7 purposes. Converting satellite measurements into quantitative precipitation estimates poses 

8 challenges. The link between tlie observations and surface rain rates depends on the 

9 calibration and operating protocol of the instrument itself, the spatial heterogeneity of the 

10 rain fields (e.g., co-cxistcnce of convective and stratiform precipitation within a single 

1 1 instrumental field-of-view and vertical heterogeneity of rainfall), the indirect nature of the 

12 measurement, and the retrieval algorithm used. As underlined by the Program to Evaluate 

13 Higli Resolution Precipitation Products (Turk et ai 2008) led by the Iniernationai 

14 Precipitation Working Group (IPWG; see hUp://www.i.sae.cnr.ilA ipwg/), characterizing the 

15 error structure of satellite rainfall products is recognized as a major issue for the usefulness 

16 of the estimates (Yang el ai 2006; Zeweldi and Gcbrernichacl 2009; Sapiano and Arkin 

17 2009; Wolff and Fisher 2009). The error characterization is needed for data assimilation and 

18 climate analysis (Stephens and Kummerow 2007) and more specifically over land in 

19 hydrological modelling of natural hazards and budgeting water resources (Grimes and Diop 

20 2003; Lcbcl et ai 2009). 

21 In this study, we focus primarily on the TRMM Precipitation Radar (PR) quantitative 

22 precipitation estimation (QPE) at ground. The methodology presented herein would equally 

23 apply to all satellite precipitation products, in particular those onboard low-cartli orbiting 

24 satellites. The TRMM-PR is currently the only active instrument measuring rainfall from a 

25 satellite plalfonn conjointly with a radiometer (TMI). PR rainfall estimates are often 

26 considered as a reference for TMI-based rainfall estimates (e.g., Yang et ai 2006; WoitT and 
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1 where a. denotes a satellite pixel and N is the number of pixels covering the domain of 

2 interest. The reference data R^(A) used to evaluate the satellite estimates should spatially 

3 match the corresponding true rainfall averaged over the same area A . 

4 

5 a) original grounJ-based products 

6 The NOAA/NSSL TMalional Mosaic and Quantitative Precipitation Estimation system 

? (NMQ/Q2) (hUp://nmq.p.U:Cdu; Zhang et al. 2011) is a set of experimental radar products 

8 comprising high resolution (0.01°, 5 rain) instantaneous rainfall rate mosaics available over 

9 the CX)NUS. The NMQ system combines information from ail ground-based radars 

10 comprising the National Weather Service’s Weather Surveillance Radar ■ 1988 Doppler 

i I (WSR-88D) network (NEXRAD) network, mosaics reflectivity data onto a common 3D 

12 grid, estimates surface minfall accumulations and ^es to arrive at accurate ground-based 

13 estimates of rainfall (Zhang ei al 2005; Lakshmanan et al 2007; Vasiloff et al. 2007; 

14 Kitzmillcr e/ £j/. 2010). Figure I shows an example of the CONUS coverage of Q2 rainfall at 

15 0725 UTC on 1 1 April 201 1 highlighting several rainy systems associated willi orography in 

16 the West and a w'ide frontal system in the central part of the domain. 

17 At hourly time step Q2 adjusts radar estimates with automated rain gauge networks 

! 8 using a spaiially variable bias multiplicative factor. A radar quality index (RQl) is produced 

19 at the (0.01", 5niin) resolution. While die true quality of the Q2 QPEs varies in space and 

20 lime due io a number of complicating factors (e.g., measurements errors, non-prccipitalion 

21 echoes, uncertainties in Z--R relationships, variability in the vertical profile of reflectivity), 

22 the RQl represents the radar QPE uncertainly associated with VPRs (Zhang et al. 2011). The 

23 RQl field is composed of a suuic part relative to the radar beam sampling characteristics 

24 such as percent blockage, beam height and width and a dynamic part accounting for the 

25 freezing level height. The sialic part is illustrated in Fig. 1 , where tltc reduced radar coverage 


1 Tlie quasi-instantaneous matching is performed at the scale of the PR measurement scale 

2 (4.5 X 4.5 km). 

3 The PR data and steps required to refine the Q2 ground-based rainfall to arrive al tlic 

4 reference rainfall used for comparisons arc presented in section 2. Section 3 assesses the 

5 ability of PR rain retrievals to represent the rainfall variability derived from the reference 

6 data in terms of rainfall detectability, sensitivity, and spatial structure. Section 4 provides an 

7 empirical error model of the PR estimates versus reference rainfall and segregates systematic 

8 and random error. The paper is closed with concluding remarks in section 5. 

9 

10 2. Data sources 

n 

12 One of the first challenges encountered is the lack of knowledge alxmi the true averaged 

13 rainfall for the spatial domains considered. One wants to compare instantaneous satellite 

14 rainfall estimates R(A) with reference rainfall R^(A) for a spatial domain A (which may 

15 be a satellite mesh, watershe4 etc.) to characterize the accurm^y of tlte saiellite QPEs. The 

1 6 true (and unknown) arca-averaged rainfall accumulation, denoted written as: 

'7 R,™(A) = i//R(x)dx (1) 

18 where X is the location vector. The reference rainfall ® proxy of The 

19 final products of the satellite data processing are gridded rainfall fields. Satellite QPEs may 

20 then be written as: 

21 R(A) = i|;f^(a) (2) 
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J difference of ihe temporal rcsolulion between the hourly adjustment factors applied 

2 downscale to 5-min Q2 rainrates. Nevertheless, Uicy provide the best possible reference at 

3 the scale of PR in terms of sampling conditions and unbiased estimates. 

4 

5 h) Q2-hased reference rainfall 

6 In the current study, all signiheant rain fiekls observed coincidentally by TRMM 

7 overpasses and the NEXRAD radar network from March to May 201 1 arc collected. The Q2 

8 products closest in time to the TRMM satellite local overpass schedule time are used. To 

9 compute the reference rainfall, a block-Q2 rainfall pixel is computed to match each PR pixel 

10 in case of TRMM overpasses in a similar manner to Kirsiciter ct al. (2010, 2011). 

1 1 Although the quamilalivc inleiprctation of the weather radar signal in terms of rainfall 

12 may be complex, radars enable a reliable evaluation of area-averaged rainfall estimates. The 

! 3 spatial variability of rainfall at small scales and the resolution difference between radar and 

14 PR Ibotprint (as much as 2 orders of magnitude in area) may cause significant discrepancies 

15 in the statistical sampling properties and adds statistical noise in the comparison (see e.g. 

16 Ciach and Krajewski (1999) for a similar issue when comparing point-mcasurcmcni 

17 raingauge to area-rainfall radar data). In order to estimate PR-pixel-averaged ground rainfall 

1 8 accumulation (and the associated sampling errors), a weighted mean estimator is considered 

19 to determine the reference rainfall over the PR footprint A from Q2 products. As 

20 the representativeness of the rainfall sampled by PR is related to the characteristics of the 
2 i radar beam, the weighting function is given by the PR beam pallcni inside a PR footprint. 
22 The rderence rainfall is therefore; 

R.,(A) = -^2“iQ2(a) wiiho,,. / f=(e,e„)d« 

ui 
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1 in the western part of US rcsulLs in lower RQI values. The dynamic part causes the RQI 

2 values to decrease in coo! season months when the freezing level is lower and the raditr 

3 samples the melting layer and the ice phase at closer range and to increase in the wann 

4 season when the freezing level is at higher altitudes, This is illustrated in Fig. I where the 

5 freezing level is lower behind a cold fronud system, which deteriorates the already limited 

6 coverage in the western pan of the CONUS. 

7 The original Q2 products utilized in this study are (i) the radar-only instantaneous rain- 

8 rate national mosaic updated every 5min, (ii) the radar-only rain-rate national mosaic at 

9 hourly lime step, (iii) the hourly raingauge-correclcd national mosaic product and (iv) the 

10 RQI. The primary Q2 product used for comparison with PR is the radar-only instantaneous 

1 1 rainratc mosaic. Current Q2 radar products tk) not include an instantaneous gauge-adjusted 

12 rainrate mosaic. For this study and similarly to Amitai et al. (2009; 2011), a second 

13 reference rainfall was derived from the bias-conected Q2 product by using the hourly gaugc- 

14 adjusted and the hourly radar-only products. Pixcl-by-pixel hourly (multiplicative) 

15 adjustment facUtrs arc calculated and applied to the radar-only instantaneous product. 

16 Extreme adjustment factors (outside the [0.1-10] range) are discarded and no comparison is 

17 performed with PR for the corresponding Q2 values. Thus, the gauge -adjustment also serves 

18 as a data quality control procedure. A subsequent reference is derived from the bias- 

19 corrected Q2 product filtered using the RQI index. Only the rainrates associated with the 

20 best RQI values (i.e., equal to 1) were retained. This selection insures that only Q2 estimates 

21 presenting the best mcasuremerits conditions (i.e., no beam blockage and radar beam below 

22 the melting level of rainfall) are retained. 

23 One should note these incremental improvements of the Q2 products may not screen out 

24 ail possible errors in ground-based radar estimates. In particular, the gauge-adjustment may 

25 suffer from representativeness errors from scarce raingauge network density and from Uie 
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1 to the FR resolution preserves the slalislical characteristics of the PR product including the 

2 total rainfall amount, the total rainy area, and the PDF shapes. All of these properties may 

3 Utcreforc be compared to the reference at once. 

4 Figure 1 shows an example of continuous mapping of the weighted mean estimator for 

5 the reference rainfall The estimator is a smoother of tlie original Q2 rain field. The 

6 maximum of the rainfall rate decreases from 145 mm lf‘ to 130 mm h"'. The total rainfall 

7 area increases, mainly at the edges of the rainficld. In order to avoid a contamination of the 

8 PR-rcfcrence comparison by the uncertainty on the ground reference, the reference pixels 

9 were segregated into “robust” (R,^, > and "non robust” (R^^, < 

10 estimators. This procedure illustrated in Fig, 1 fillers out the reference values at the edges of 

I ! the rain fields. Non-robust reference values arc discarded for quantitative comparison. The 

12 robustness check is applied to the three Q2 products considered for reference (native Q2, 

1 3 bias corrcclcd Q2, RQl+bias corrccled Q2). As an example for the “RQI+bias corrected Q2” 

14 the averaged reloiive error ^ reference decreases from 832% to 16%. The 

15 ratio of the mean error to the standard deviation of the reference A^^ref)) decreases 

16 slightly from 5.6% to 5.4%. This method of reference selection therefore increases the 

!7 reliability and representativeness of the block-Q2 values that constitute our ground 

1 8 reference. 

19 

20 c) Precipilalkm Radar (PR) based rainfall 

21 The PR measures retlectivity profiles at Ku band. Surface rain rales are estimated over 

22 the southern US up to a ialilude of 37‘’N (Fig. 1). Artifacts such as contamination by surface 

23 backscalter, allemiation and extinction of the signal, brightband effects and accuracy of the 

24 Z-R relationship (Wolff and Fisher, 2008) must be accounted for. In the present study, the 
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where notations have been simplified for the sake of convenience. Q2 denotes the Q2 rain 
rale product for the mesh . The value R^^(A) depends on the number n of Q2 meshes 
inside the PR footprint; the weights w arc derived from the two-way no^nali^ed power-gain 
function of the radar antenna f (assumed to be Gaussian) and the beamw idth 0^ ; each is 


computed over the domain corresponding to the Q2 mesh . It is assumed the PR 
footprint remains constant (circle of approximately 5 km) whatever the radar beam off-nadir 
inclination angle. Additional research may be needed to lake into account the deformation of 
the footprint with off-nadir angle (Takahashi el al, 2006). 

Two weighted standard cnors are computed with the reference rainfall. The first one is 
the weighted sample stamiard deviation, which repre.seiiis the variability of the Q2 rainfall 
(at native resolution) inside the PR footprint: 


too^int 31 - V 


. I (Q2(a,) ^ R^^,(A))' w,th V, - J (», V, - J 


It is used to select the PR-refcrence pairs for which the is trustworthy. The second 


one is the standard deviation relative to the weighted mean R^^(A): 


It allows us to assess the R^^f(A) estimation quality. 

Matching PR and R^(A) estimates only exist at locations where both the PR and 
ground radars have taken actual observations. This technique averages the minimum number 
of Q2 meshes needed to produce .spatially coincident sample R^^^CA) estimates. The 
advantages of the current technique over gridded approaches are that there is no 
interpolation, extrapolation, smoothing or oversampling of PR data. Bringing the Q2 product 
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1 dcviaiion from the 1:1 degree line compared to the whole distribution. The reference 

2 distributions iirc fairly stable given the different censoring levels with the mean of the PR- 

3 i-esampicd distributions being within 7% of the one for the whole damsel. We may therefore 

4 consider each reference dataset to be quite rcprcsenialive of the corresponding whole rainfall 

5 distribution, 

6 Similarly we compared the different PR datasets to assess the impact of censoring on 

7 ihcir represcniaiivencss. Figure 4 shows quantile-quantile plots between (i) the complete 

8 (“iNalive”) PR data set (x-axis) and (ii) the censored subsets according to the “Bias 

9 corrected” and “Bias+RQI corrected” samples. Table 3 provides values of the conditional 

10 mean and standard deviation for each set. The different PR raiiifal! distributions do not show 

1 1 a clear deviation from the 1 ; 1 degree line compared to the “Native” PR rainfall distribution. 

12 The means and standard deviations of the “Bias correctcd”-ccnsored and “Bias+RQI 

13 correcled”-eensored distributions arc less tiian 1% and around 10% higher resf»ctively. We 

14 may therefore consider the representativeness of each PR dataset, following censoring stqjs, 

1 5 to be quite comparable to each other. 

16 

17 3. Rainfall data analysis 

18 

19 This section reviews the ability of PR rain retrievals to represent the rainfall variability 

20 derived from the Q2 data. First, contingency tables provide information on the reference 

21 rainfall reliability and on the influence of PR sensitivity to delect rainfall occurrence. The 

22 PDF of rainfall estimates provide in-depth information on the sensor’s global ability to 

23 capture rain regimes given the influence of its sensitivity and the attenuation of the radar 

24 signal. Another feature to compare is the spatial structure of rainfall fields. 

25 


1 surface rain rale at each PR footprint location Is a standard TRMM product (2A25 v6) 

2 described in Iguchi ef al. (2000). The scaii geometry and sampling rate of the PR lead to 

3 footprints spaced approximately 4.3 km cross and along-track {5.1 after TRMM boost), over 

4 a 2 1 5-km-widc swath. The minimum theoretical delectable rain rate by the PR is fixed by its 

5 sensitivity and is about 1 7 dBZ, or -0,5 mm h'* . 

6 

7 d) Comparison samples 

8 Several factors including rainfall intenniltcncy, discrete temporal sampling of TRMM 

9 and censoring of reference values for required quality reduce the number of compari.son 

10 samples for reference and PR estimates over the comparison period. Table i provides the 

1 1 number of these samples for the reference values, inclusive and exclusive of non-rainy 

12 pixels. The comparison sample sizes in Table 1 arc primarily dnven by the number of rain 

13 evente and the overpa.ss frequency of TRMM, then by the censoring of reference values. The 

14 quality control in the bias adjustment discarded 26% of original Q2 values and an additional 

15 34% were filtered using RQl. Note that after two levels of prix:cssmg and censoring, the 

16 comparison sample size for the “RQl+bias corrected Q2” remains significant at 393 347. 

17 Tilts is credited to the large number of sample.s offered by the high-resolution, gridded Q2 

1 8 product. 

19 To assess the representativeness of our spatially and temporally limited samples, we 

20 compared the statistics of the reference rainfall resampled to the PR-pixel resolution with 

21 respect to the whole reference dataset (CONUS-widc below 38"N which don't necessary 

22 match a TRMM overpass). Figure 3 shows quantile-quantile plots between (i) the whole 

23 reference data set (x-axis) and (ii) the subset of pixels that matched to PR-pixel resolution 

24 for the different reference datasets. Table 2 provides values of the conditional mean and 

25 standard dcvmtion. The PR-resarapled reference rainfall distribution docs not show a clear 
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1 volume. Note ihc lowest values (less than 8%) arc obtained willi the “Bias tRQI corrected 

2 Q2” reference, 

3 The impact of the reference rainfall on the contingency scores is shown in Figure 5. 

4 Contingency values arc used to compute probability of detection (POD), false alarm rales 

5 (FAR), and critical ,succc.ss index. (CSI). Scores are generally better for the robust reference 

6 than for the non-robusl one. Within this category CSI shows a general increase with 

7 sequential Q2 data quality steps, while the FAR shows the lowest values with additional 

8 processing of llie Q2 reference. A general convergence between the Q2 reference and PR 

9 estimates is therefore acknowledged as a function of the reference accuracy. 

10 Considering that 80% of the reference rain rales that are not detected by the PR are lower 

11 than 0.3 mm.h‘‘, the sensitivity of PR is close to this value. The misses arc probably 

12 associated with high inlermittency and/or the “rain/no rain” limits of rain fields. These 

13 features are missed by the PR because the rainrales are close to the detection threshold. This 

14 suggests that the PR can indeed capture the main rain regions but loses the weaker echoes 

15 (Schumacher and Houze 2000), probably due to its sensitivity. 

16 

1 7 h) ProbahiUty dLslribuiiom by occurrence unci rain volume 

18 Hereafter, the PR rain estimates arc the conditional ones (positive rainfall) coincident 

19 and collocated with nonzero reference estimates. Two PDFs for PR versus reference rainfall 

20 arc computed and shown in Fig. 6: (i) the PDF by occurrence (PDFc) and (ii) the PDF by 

21 rain volume (PDF,.) (WoUT and Fisher, 2009; Amitai et ai, 2009-2011). The PDFc provides 

22 statistical information on the rain rate distribution and highlights the estimate’s sensitivity as 

23 a ftmclion of rainrate; it is computed as a ratio between llic number of the rainrates inside 

24 each bin and the total number of rainrales. The PDF, represents the relative contribution of 

25 each rainrate bin to the total rainfall volume; it is computed as a ratio between the sum of the 


1 a) Contingency tables 

2 Table 4 shows the contingency tables for PR rain/no rain occurrence relative to die 

3 references with percentile of hits (H; both Q2 and PR delect rain), misses (M; PR does not 

4 detect rain while Q2 does), false alarms (F; PR detects rain while Q2 docs not), and correct 

5 rejections (C; both Q2 and PR do not delect rain). The reference data are separated into tliree 

6 sub-samples: the non-robust set (R^^, < . see section 2b), the robust set > 

7 . .) and the “whole” 02 set. Reference null values are considered as robust. All 

footprint ' ^ 

8 coincident and collocated PR values are considered and sorted according to the reference 

9 samples. Table 5 provides the mean rainfall values according to tiie same contingency tables 

10 with PR on the left hand side of the “/” sign and the reference on the right hand side. 

1 1 The false detections (M t F) of PR arc mainly associated with the non-robust reference 

12 data; more than 80% for all “non-robust sets”, while around 50% are improperly classified 

13 when using the “valid” reference data set. The Misses (M) arc the main contributors to the 

14 false detection population (i.e., approximately 85% for the “whole” data set). These Misses 

15 of PR arc coincident with low reference values (less than 0. 1 5 mm h'‘ for tlic non-robust set 

1 6 for all references; see Table 5). By comparison, the correct detections (I I + C) of PR arc 

17 mainly associated with the robust reference set from 45% to 52%. For the same robust 

18 reference sets, the Hits of PR are coincident with the higher reference values with mean 

19 rainfall rates more than 6 mm h '. One should note for all references that (i) the mean PR (F) 

20 values are significantly lower than the PR (H) values, and (ii) the mean reference (M) values 

21 arc significantly lower than the mean reference (H) values. Finally both mean reference and 

22 PR values are higher for the robust Q2 set than for the non-robust Q2 set. Table 6 shows the 

23 discarded rain volumes in question; the Misses of PR represent less than 12% of the 

24 reference rainfall volume, while False Alarms represent ies.s than 16% of the PR rainfall 


14 


13 



1 simple funciion, we use a normalized variogram, which represents the spatial correlation of 

2 tlie rain field (Joumcl and lluijbrcgis 1978; Lcbcl e! al. 1987; Kirstetter el al. 2010; 201 1). 

3 An appropriate model is fit to the empirical normalized variogram. Among the set of 

4 classical models, the exponential model was found most suitable, It is expressed as: 



6 where the tlimc paramctcis are the nugget (C^), the sill (C) and the variogram range 

7 parameter (d). Tlie exponential model reaches its sill asymptotically as h -»■'». The 

8 “effective range” corresponds to the mean decorrelation distance of the eslimalcs. It is the 

9 dislancc where the variogram reaches 95% of its maximum and con esponds to 3d for the 

10 exponential model. The nugget parameter can be used to describe a possible discontinuity of 

1 1 the variogram at the origin which may be due to (i) the process variability at scales poorly 

12 resolved by the observation system and/or (ii) measurement errors. In the following, these 
i 3 paramctcis arc used to characterize the structure of rainfall. 

14 Spatially normalized variograms of references and PR estimates arc displayed in Fig. 7. 

15 Table 7 summarizes the parameters of these variograms. The variogram ranges of PR arc 

16 quite similar to the three references’ (approximately 18km). The nugget values, however, are 

17 more distinct. While it is ~ 32% for the Q2 references, it is significantly higher for PR 

18 (approximately 45% of the sill). These decorrelations of spatial structure al short 

19 intcrdislances suggest the resolution of the PR measurements may be limited when sampling 

20 the variability of small, disorganized rainfall structures associated with localized convection. 

2 1 The smaller reference nugget is an indication of the bolter sampling of the rain field by the 

22 reference rainfall, an issue previously discussed in section 2b. The comparatively higher 

23 nugget with PR may be caused by the rain intcrmiticncy, coniammaiion by surface 

24 backscallcr, attenuation of the signal, brighlband effects or inaccuracy of the Z-R 


1 rainrates inside each bin and the total sum of rainralcs. It is therefore an imporUml 

2 characteristic of tlie instantaneous products from the perspective of building merged rainfall 

3 accumulations; it enables a comparison of PDFs based on estimates derived from 

4 instjoimenls characterized by different detection limits (in particular al weak intensities). 

5 The rainrates of PR exhibit similar PDFc for all references. Compared to reierenccs’ 

6 PDF,., PR tends to overestimate light rain rates (-[0.3-0.5] ram h *). But, PR demonstrates 

7 poor detection of the lightest rain rales (below ~0.3 mm h ‘) compared to the two bias 

8 corrected references. This is coherent with the concept of rain area “edges” that might be 

9 only partially detected by PR, resulting m misses associated with low rain rales (see previous 

10 section). PR PDFc presents similar features with references for rain rales > -1 mm h"’. One 

1 1 may note the improved convergence between PR and reference rainfall PDFc in the rain rates 

12 interval [0.5-1 .0] mm with the ^quential Q2 data quality steps, 

1 3 Despite the low occun^nce of relatively high rain rates (> 10 mm.h'*), their contribution 

14 to the total rainfall volume is significant (greater than 60 %). As a consequence, the mode of 

15 PDFv for PR is shitlcd toward lower rainrates (~I8 mm h’’) compared to the reference’s 

16 mode (-60 mm h ‘), in agreement with the results found in Amilai el al. (2006, 2009). This 

17 is attributed to high rainfall rates (> 10 mm.h'*), which arc evidently underestimated by PR 

18 because insufficient correction due to attenuation losses as suggested by Wolff and Fisher 

1 9 (2008) for the 2 A25 version 6. 

20 

2 1 c) Space structure of estimated rainfall fields 

22 For hydrological applications, the total amount of water over a basin a.s well as the 

23 location and spatial correlation within the catchment might be important. It is therdbre 

24 relevant to assess the ability of space-based estimates to retrieve the spatial structure of 

25 rainfall fields as seen by the reference. In order to describe the structure by a relatively 
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1 ihe racial). The gauge-based bias correction of the native Q2 product decreases the mean 

2 reference values, so the negative bias of PR is apparently improved. The additional RQI 

3 filtering removes tlie underestimation of Q2 at far range so the bia.s of PR i.s degraded. The 

4 reference shows higher standard deviation than the PR in coherence with the PDF features 

5 presented in section 3b. 

6 The correlation coeftkients between PR and Q2 reference estimates arc moderate 

7 (around 0.6). One could note the best correlation between the two sensors is achieved with 

8 the "Bias-t RQI corrected” reference. The differences between the two products on a poiiit- 

9 lo-point comparison basis can be attributed to sample volume discrepancies, liming and 

to navigation mismatches and the uncertainties in the respective rainfall estimates. The 

1 ! significantly greater nugget in the PR variogram than in the reference variogram is also an 

1 2 indication of the greater level of noise in the PR rain field spatial structure, which may limit 

13 the con clalion between the two series on a point-to-point comparison. 

14 

1 5 h) error model 

16 The departures of PR estimates from the references arc analyzed in this section on a 

17 poinl-lo-poinl basis. The uncertainties asswiated with satellite estimates of rainfall include 

18 systematic errors as well as random effects from several sources (Yang el al., 2006; 

19 Kii'stetter ei ai, 201 1). There is a fundamental i.ssuc in segregating the proportion of the 

20 scatter due to purely random error and the proportion due to conditional biases of the PR 

2 1 eslimate.s that may be either positive or negative, producing additional scatter. 

22 With the true rainfall being unknown, the residuals are defined as the difference 

23 E = (R - between the reference rainfall (R^^^ ) and the satellite estimates (R). Only 

24 pairs for which R^^^ and R are both nonzero arc considered in the calculations in order to 

25 emphasize the PR ability to quantify precipitation where it is raining. The sets of e 


1 relationship. An interesting feature is that both sensors present a slightly decreasing nugget 

2 with the sequential Q2 data quality steps. This feature could be attributed to the censoring of 

3 the reference, which filters out complicated sampling situations for the ground-based radars. 

4 

5 4. Quantitative error modelling 

6 

7 a) Correlalions and biases 

8 Scaiierplots of PR versus reference rainfall are presented for the three sets of Q2 

9 reference in Fig. 8. Classical performance criteria of satellite-based rainfall estimation 

10 compared to reference values arc listed in Table 8; correlation coefficient and mean relative 

1 1 error (MRE), expressed in percentage aiul defined as MRE ~ (PR mean - 

12 Ref racan)/Ref mean. The comparisons between the PR and reference estimates are 

13 assessed on a point-to-point basis. A rainy pixel is included in the statistics if both PR and 

14 the reference are nonzero to emphasize the PR ability to quantify precipitation when it is 

1 5 raining. This is particularly significant given the si^ificant misses of PR. 

16 The two sensors present coherent mean and standard deviation values as long as the 

17 representativeness of the comparison samples are kept in mind. As expected, Ute means of 

18 the three PR sets arc quite similar. In all cas<» the PR underestimates the reference mean 

19 values by ~1 7%. 1'his is once again attributed to the significant underestimation of the higher 

20 rainrates in the 2A25-v6 products, presumably due to attenuation losses. The variations of 

21 the reference mean for the three sets explain in large part the variations in the apparent bias 

22 of PR relative to the reference. The native reference set is affected by (i) a global 

23 overestimation of rain rates, which could be due to the inaccuracy of the Z-R relationship 

24 and (ii) an underestimation of rain rates linked to partial beam blockage and vertical profile 

25 of reflectivity effects (i.e., overshooting above the melting layer by the radar beam far from 
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1 Several iwo-parairicler density functions (log normal, normal, reverse gumbcl, logistic, 

2 gamma, etc,) have been tested to til tiic data. The distributions of residuals (not shown here) 

3 were generally found to be unirnodal and asymmetric. The goodncss-of-fii on the whole 

4 dataset has been checked by investigating the Akaikc information criteria (AIC) for the each 

5 scmi-parameLric density fits. The reverse Gumbcl distribution 


6 



), where p is llie mean and a the standard deviation 


7 of the residual population) was found to be the most appropriate. Figure 9 shows the 


8 residuals as a function of as well as the tilted GAM model for PR in the representative 


9 ease of the “Bias+RQ! corrected” reference. The conditional PDF of residuals £ present a 


H.) high conditional shift versus the 0 line and a high conditional spread. 'Note that for > 

1 1 ~50mm.h‘^\ the model is quite undelcnnined because of the lack of observed residuals. All 

12 models show that PR present a tendency to ovcreslimalc light rain rates (the median of 

13 residuals is positive) and underestimate higher rain rates (negative median of residuals): e.g. 


!4 PR underestimates R . -- 20 mm.h ' rain rates with an occurrence of 70% and with a 

ref 


!5 representative bias of -7 mm.h ‘ and underestimates R^^^ - 40 mm.h'’ with an occurrence of 

16 92% and with a reprcscnlalive bias of -24 mm.h '. This is likely to be once again due to the 

17 insufficient coiTcclion of PR attenuation for heavier rain rates. 


18 In case of a non-symmeiric density for residuals or in ease of extreme values, the median 

19 is prclerrcd to the expectation for a belter reprcscnlalivcness of the systematic component of 

20 the residuals. The systematic error component (i.e, conditional bias) is therefore described 

21 by tlie conditional median of these distributions. For the .same reason we consider the 

22 inierquanlile (q90-q!0) value to assess Ute random part of the error. It is computed after 

23 having applied the error .separation variance conection to the conditional standard deviation 
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1 distributions are studied using the generalized additive models for location, scale and shape 

2 (GAMTSS, Rigby and Stasinopoulos 2005) technique. As a preliminary step, is 

3 considered as the main driving (explanatory) variable conditioning ti\c departures of PR 

4 estimates from references. 

5 Generalized linear models for location, scale and shape aim at modeling the parameters 

6 of a response variable’s distribution. Two main assumptions are made: (1) the response 

7 vari^lc e is a random variable following a known parametric distribution with density 

8 f(e|p,a) conditional on the parameters (ft, a); (2) the observations e are mutually 

9 independent given the parameter vectors (ft^ o ) . Each parameter is modeled as a function of 

10 (the explanatory variable) using monolonic (lincar/non-linear or smooth) link 

11 functions. More details are provided by Rigby and Stasinopoulos (2001, 2005), 

12 Akantziliotou, Rigby, and Stasinopoulos (2002) and Stasinopoulos and Rigby (2007). A 

13 wide vmiety of distributional forms are available, but for the sake of simplicity and to 

14 distinguish between systematic and random errors, a number of conditional densities with 

15 the first two moments (the location ft - mean, to be linked on to systematic errors - and the 

16 scale o - standard deviation representotive of random errors) as parameter are considered 

17 here. For a given conditional distribution of the response variable, the conditional quantiles 

18 can be expressed as a function of the location and scale. GAMLSS is best titled using the 

19 package gamlss in R (Stasinopoulos and Rigby 2007). 'fhe rainfall trends for each parameter 

20 arc fitted using locally weighted scatlerplot smoothing (loess), which are more flexible than 

21 polynomials or fractional polynomials for modelling complex nonlinear relationships. It is a 

22 polynomial curve determined by R^^^ , which is fitted locally by weighted polynomial 

23 regression, giving more weight to points near the point whose response is being estimated 

24 and less weight to points furtlier away (see Cleveland, Grosse, and Shyu 1993). 
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1 conditional bias is less significant), which could be seen as a sign of a better convergence 

2 between PR estimates and this Q2 i-cfcrencc. This is confirmed when considering the random 

3 part of error. The “Bias t-RQI corrected” curve shows the lowest random errors up to = 

4 4 mm h ' (more than 65Vo of the reference rain rales are under this value). The random error 

5 increases consistently with R^^^ , It is systematically higher for the “Bias corrected” than for 

6 the '‘Native” reference, a result consistent when applying a bias correction (Ciach et al 

7 2000). It represents a significant part of error, suggesting that other factors than R^^^ could 

8 be considered to evaluate the error of PR rain rate estimates at ground. 

9 

10 5. Conclusions 

U 

12 In preparation for NASA’s future Global I^recipilalion Measurement (GPM) mission, a 

13 ihfee-month data sample of TRMM-PR-bascd rainfall products have been compared to 

14 surface rainfall derived from Q2 over the lower conterminous US. The major advantage of 

15 the Q2 ground-based reference dataset is its resolution in both lime and space commensurate 

16 with rainfall estimates derived from sensors onboard low-earth-orbiting satellites. The 

17 compansons have been performed at the PR-pixel resolution. A framework is proposed 

18 herein to address methodological issues so as to provide a preliminary version of an error 

19 model for satellite QPEs. The error model is empirically derived and is thus prone to be 

20 specific to the dataset considered and the PR/Q2 data processing implemented. However, the 

21 results show similarities with previous rainfall comparisons over West Africa (Benin and 

22 Niger) and thus give credence to the developed framework (Kirslettcr et al. 2011), Results 

23 from the enor model presented herein provide insights into the most significant 


1 o extracted from the GAM model. Tlie error separation variance concept (Ciach and 

2 Krajewski, 1999; Tco and Grimes, 2007; Kirslettcr el al. 2010) makes it possible to evaluate 

3 the variance of the PR with respect to the true unknown rainfall. We assume the errors on the 

4 reference rainfall and on the PR estimates to be unconelalcd. Introducing the true rainfall 

5 in the expression of the variance of the residuals between the PR and relerence values 

6 leads to (sec Kirslettcr el al. 2010 for details): 

8 Fortunately as can be seen in Figure 10, the reference estimation standard deviations are 

9 lower than the standard deviations of the PR-refcrencc residuals, indicating the reference 

10 values to be comparatively reliable to evaluate PR. The standard deviation of the PR 

11 residuals with respect to the true rainfall is significantly reduced compared with the PR - 

12 reference residual standard deviation. One may note the standard deviatioas increase up to a 

13 reference value (-50 mm.h'*) beyond which we believe sampling issues lead to a 

14 stabilisation or a decrease of the standard deviations. We therefore apply the modelling up to 

15 this limit only. As ~98% of the reference values are under his limit, this choice won’t lead to 

1 6 any significant lack of representativeness. 

17 Figure 10 shows the conditional biases and random errors of PR relative to the three Q2 

18 references. Tlie global bias (sec previous section and Table 8) of PR re.sults from a balance 

19 between ovcrcslimation of light rainrates and underestimation of high rainrates. Tlie 

20 underestimation is more frequent, inducing a global negative bias. The conditional biases of 

21 PR relative to the references are quite similar. Note the “Bias corrected” conditional bias is 

22 shifred to the right compared to the “Native” one, so ovcrcslimation of light rainrates is more 

23 significant and the underestimation of higher rainrates less pronounced, consistently with tlte 

24 reduced negative global bias for this specific reference (see Table 8). Note also the negative 

25 slope of the “Bias+RQI corrected” conditional bias is lower than for the two other (the 
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1 other sensors onboard low-carlh-orbiiing satellites (i.e,, TMI, AMSR-E, SSMI, MADRAS). 

2 This fTamework will also be applied to GPM rainfall estimates following its launch in 2013. 

3 Another important issue to study Is how the various error sources in PR, which is often used 

4 as a calibrator, propagate when merging with geostationary infrared data for a number of 

5 satellite-based, high-resolution precipitation products. 

6 

7 

8 
9 


1 characteristics of PR rainfall retrieval errors that need to be taken into account when such 

2 data are used in applications. 

3 A consistent result noted throughout eitch analysis was the increased consistency 

4 between PR and the Q2 reference following sequential data quality control steps including 

5 bias correction using rain gauges and filtering using the radar quality index (RQI) product. 

6 This finding, alone, highlights the importance of matching the scales and refining the 

7 accuracy of the reference dataset as much as possible before reaching meaningful 

8 conclusions about the PR accuracy. 

9 Different error sources were identified and quantified for PR rainrate estimates. The 

10 most significant error is most likely due to the attenuation of the PR radar signal. It is not yet 

1 1 known if this error is due to inadc-quatc correction for attenuation losses or complete loss of 

12 the signal. Segregating rain from no-rain boundaries is also a driving contributor to the PR 

13 rainrate errors, probably linked to the lack of sensitivity in the most inhomogeneous and 

14 light parts of tlie edges of rainy regions. Nevertheless, the variogram analysis showed that 

15 the PR adequately represents the spatial structure of the rain fields. The scattcrplots revealed 

16 PR-cstimalcd rainrales are only moderately correlated (Pearson correlation coefficient of 

17 0.6) to the best reference rainfall on a point-to-point basis. 

18 The statistical model developed here quantifies the relation between instantaneous PR 

19 rainfall and the coiTcsponding reference rainfall. It consists of a deterministic additive 

20 function and a random uncertainly component, both conditioned on given reference values. 

21 The contribution of systematic PR errors is confirmed to be quite large tiue to the 

22 aforementioned signal attenuation issue. 

23 In tenns of perspectives, the relative contributions of eiiors linked to rainfall type and 

24 off-nadir angle need to be evaluated, as well as influence of the underlying terrain. The same 

25 framework and reference rainfall datasets can be readily applied to rainfall retrievals from 
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4 Table I . Comparison samples for diffcrcni reference datasets. 

5 Table 2. Conditional mean and standard deviation of “whole” and “PR-resampled” 

6 references datasets. 

7 Table 3. CoiKlitional mean and standard deviation of PR estimates for different references. 

8 Table 4. Contingency table for PR relative to the three references. The results are provided 

9 for robust / non robust reference data according to a criterion based on the variability of the 

10 Q2 rainfall (at native re^lution) inside the PR footprint ( )• 

! 1 Table 5. Mean raini'all values associated to the contingency table for PR / references. 

12 Table 6. Di:«:arded rain volumes from PR due to misses relative to references and rain 
! 3 volume implied in the false alarms relative to robust references. 

14 Table 7. l*aramelcrs of the normalized variograms (exponential model) for references and 

15 PR. The “efrcctivc range” values are indicated. The nugget is expressed as a percentage of 

i 6 the normalised sill. 

17 Table 8. Pcrlbrmancc criteria values for PR estimates: mean, standard deviation, mean 
IK relative error (MRE) and correlation (R) with respect to references. Only the reliable Q2 data 

19 arc kept (see section 2.b) for references. 
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1 


Figure 8; Scaltcrgraphs of PR versus native (a), bias corrected (b) and Bias+RQI 

2 con'ecled(c) reference rainfall (mm If*). The first bisectors (solid lines) are displayed. 

3 figure 9: PR residuals represented versus “Bias+RQI corrected” reference (left) and the 

4 GAM model fitted is represented by [5, 10, 20, 30, 40, 50, 60, 70, 80, 90, 95] conditional 

5 quantile lines (right). 

d Figure 10: Standard deviation of PR-rctcrcnce residuals (dashed line), estimated standard 

7 deviation of the reference rainfall (dotted line) and standard deviation of PR- tnie rainfall 

8 residuals (solid line) as functions of ilic “Bias+RQI corrected” reference. The vertical line 

9 (50 mm.h'^) indicates the limit of the good sampling conditions. 

10 Figure II: Conditional bias (median) of residuals (left) and conditional random error 
1 J (inierquaniilc 90%-l0%) of residuals (right) for PR as a function of “Native” (dotted line), 

12 “Bias corrected” (doited line) and “Bias+RQI corrected” references. 
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2 Figure captions 

3 

^ Figure 1: Map of CONUS area w'ith NMQ/Q2 instantaneous rainrates at 0725 UTC on 07 

5 April 2011. The red area shows the good quality radar coverage corresponding to Radar 

6 Quality Index equal to 1 . The shaded area is not sampled by the TRMM-PR. 

7 Figure 2: Maps of instantaneous rainrates at 0725 UTC on 07 April 2011: the NMQ-Q2 

8 product (lop left), the equivalent reference rainfall (top right), the “robust” reference set 

9 (bottom left) and the “non robust” reference .set (boliora right). 

10 Figure 3: Quantile-quantile plots for reference “PR-sampled” and “Whole” rainfall 

11 distribution comparison, for native (a), bias conected (b) and Bias+RQI corrected (c) 

12 references. The positions of 10, 50 and 95 percentiles are showed for each distribution. 

Figure 4: Quantiic-quanlile plots for reference “PR-sampled” and “Whole” rainfall 

14 distribution comparison, for native (a), bias corrected (b) and Bias+RQI corrected (c) 

15 references. The positions of 10, 50 and 95 percentiles are showed for each distribution. 

16 Figure 5: Critical success index (CSI), probability of detection (POD) and false alarai rates 

17 (FAR), and for the three references and partitioned as a function of robustness. 

18 Figure 6: Probability distributions of rain rales the PR rainfall and for the native (a), bias 

19 corrected (b) and Bias+RQI corrected (c) reference rainfall. The solid and dashed-doUed 

20 lines represent the distribution by volume PDFy and the distribution by occurrence PDI'c 

21 respectively, while the grey and black lines represent the distributions for references and PR 

22 respectively. Note that the x-axis is in log-scale. 

23 Figure 7: Spatial variograins for reference (left) and PR (right) for the native (lop), bias 

24 corrected (middle) and Bias+RQI conected (bottom) reference. The empirical variograms 

25 are plotted with crosses, and the models ftUed are represented by the thick black lines. 
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2 TABLE 4. Contingency table for PR relative to the three references. The results are provided 

3 for robust / non robust reference data according to a criterion based on the variability of the 

4 Q2 rainfall (at native resolution) inside the PR footprint )• 

5 


PR 

Native Q2 

Estimates 



>0. 

-0. 

Z estimates 


whole set 

26% 

6% 

320715 

> 0. 

robust 

45% 

15% 

251175 


non robust 

12% 

0% 

69540 


whole set 

67% 

0. % 

664220 


robust 

40% 

0. % 

157986 


non robust 

88 % 

o.% 

496234 


whole set 

921758 

63177 

984935 

I reference 

robust 

355984 

63177 

419161 


non robust 

545774 

0 

565774 


6 

7 

8 
9 

10 

11 

12 

13 

14 


2 TABLE 1 . Comparison samples for diiTerent reference datasets. 



Including 
non-rainv 
{0 mm h'^) 

Rainy only 

Native Q2 

35 349 900 

984 598 

Bia.s corrected Q2 

35 342 653 

723 495 

Bias-t RQi corrected Q2 

35 342 553 

393 347 


3 

4 

5 TABLE 2. Conditional mean and .standard deviation of “whole” and “PR-resarapled” 

6 references datasets. 



PR resampled dataset 

Whole reference data set 


Mean 

St. dev. 

Mean 

St. dev. 

Native Q2 

1.64 

6.55 

L.57 

6.30 

Bias corrected Q2 

2.00 

6.99 

1,95 

6.84 

Bias + RQI 
correcid Q2 

1.98 

7.26 

2.13 

7.37 


7 

8 

9 TABLE .3. Conditional mean and standard deviation of PR estimates for different references. 



Mean 

Standard deviation 

Native Q2 

4.21 

6.91 

Bias corrected Q2 

4.24 

6.94 

Bias^-RQI corrected Q2 

4.65 

7.47 


10 

11 

12 
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2 TABLE 5. Mean rainfall values associated lo the contingency table for PR / references. 

3 


PR 

Estimates 

Native Q2 

>0. 

-0. 

> 0. 

whole set 

4.65 / 5.06 
5.07/6,21 
3.51 / 1.97 

2.41/0.00 

2.41/0.00 

robust 

non robust , 


whole set 

0.00/0.31 


HI 

robust 

0.00 / 0.92 

- 


non robust 

0.00/0.10 1 



PR 



Bias corrected Q2 

Estimates 1 

* >0. 

-0. 


whole set | 

4.83/4.71 

2.28 / 0.00 

> (i. ^ 

robust 

5.38 / 6.07 

2.28 1 0.00 


non robust ' 

; 3.61/1.73 1 

- 


whole set i 

■| 

0.00/0.38 


■-0. 

robust 

non robust | 

0.00/1.05 1 

1 

i 0.00/0.14 1 

L- - 

- 


5 

6 

7 

8 
9 

H) 


PR 

Bias corrected Q2 

Estimates 

>0. 

= 0. 

I estimates 


whole set 

34% 

10% 

316941 

>0. 

robust 

48% 

21 % 

240223 


non robUvSt 

20 % 

0% 

76260 


whole set 

56 % 

0. % 

406610 

-0. 

robust 

31 % 

o.% 

108218 


non robust 

80 % 

o.% 

298392 


whole set 

650567 

72984 

723551 

X reference 

robust 

275915 

72526 

34S44I 


non robust 

374652 

0 

374652 


2 

3 


PR 

Bias+RQI corrected Q2 

Estimates 

>0. 

= 0. 

X estimates 


whole set 

32% 

3% 

137978 

>0. 

robust 

52% 

1% 

94533 


non robust 

18% 

0% 

43178 


whole set 

65 % 

0. % 

254921 

=0. 

robust 

41 % 

0. % 

64620 


non robust 

81 % 

0. % 

190301 


whole set 

3800S7 

12812 

392899 

X reference 

robust 

146608 

12545 

1.59153 


non robust 

233479 

0 

233479 
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1 


2 

3 TABLE 7. Parameicrs of the normalized variograms (exponcnlial model) for references and 

4 PR. The “effective range” values arc indicated. The nugget is expressed as a percentage of 

5 the nonnalised sill. 

6 



Reference 

PR 


— 

Nugget 

Range 

r 1 

Nugget 

Range 


(% sill) 

(km) 

(% sill) 

(km) 

Native 

34 % 

17 

48% 

16 

Bias coiTCCted 

32 % 

15 

48% 

16 

Bias+RQl corrected 

31.5% 

15.5 



45% 
1 

15 


7 

8 

9 TABLE 8. Pcrfonnance criteria values for PR estimates: mean, standard deviation, mean 

1 0 relative error (MRE) and correlation (R) with respect to references. Only the reliable Q2 data 

1 1 are kept (see section 2.b) for references. 


PU 

Native 

Bias corrected 

Bias+RQI 

corrected 


Reference 

PR 

Reference 

PR 

Reference 

PR 

Mean 

6.20 

5.07 

6.07 

5.38 

7.27 

5.6 

standard deviation 

12,53 

7.80 

12.04 

8.03 

13.76 

8.26 

MRE / reference (%) 

- 

-18% 

_ 

-n % 

- 

-23 % 

Conciation / reference 

- 

0.61 

- 

0.6 

- 

0.64 


12 

13 

14 


PR 

Bias+RQI corrected Q2 

Estimates 

> 0. 

-0. 


whole set 

4.92/5.45 

2.07 / 0,00 

>0. 

robust 

5.60/7.27 

2.07 / 0.00 


non robust 

3.63/2.01 

- 


whole set 

0.00 / 0.28 


-0. 

robust 
non robust 

0.00 / 0.74 
0.00/0.12 

' 


2 

3 

4 TABLE 6. Discarded rain volumes from PR due to misses relative to references and rain 

5 volume implied in the false alarms relative to robust references. 



Native Q2 

Bias corrected 

Q2 

Bias + RQI 
correetd Q2 

Excess of rain volume 
implied in False 
Alanns 

13.70% 

15.45 % 

5.36 % 

Discarded rain volume 
due to Misses 

11.70% 

10.07 % 

7.46 % 
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Fig u r e 1: Map of CONUS area with NMQ/Q2 instantaneous rainraics at 0725 UTC on 07 
April 2011. The red area shows the good quality radar coverage corresponding to Radar 
Quality Index equal to I. The shaded area is not sampled by the TRMM-PR. 
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f-i^iuic ^ Quanlilc-quanlilc plots for reference “PR-sampled” and “Whole” rainfall 
distribution comparison, for native (a), bias corrected (b) and Bias+RQl corrected (c) 
references. The positions of 10, 50 and 95 pcrceniilcs arc showed for each distribution. 
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Q2 @ PR pixel resolution 
"whole set" reference 


Figure 2: Maps of instantaneous rainrates at 0725 UTC on 07 April 2011; the NMQ-Q2 
product (top left), the equivalent reference rainfall (top right), the “robust” reference set 
(bottom left) and the “non robust” reference set (bottom right). 

2 

3 

4 

5 


non robust reu^rence 


41 


iijlisssssssssss 




1 


2 



Whole set reletsnce Robust reference Non robust reference 

Figu re 5 : Critical success index (CSI), probability of detection (POD) and false almin rates 
(FAR), and for the three references and pariiiioncd as a function of robustness. 
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Figure 4: Quantile-quantile plots for reference “PR-sampled” and “Whole” rainfall 
distribution comparison, for native (a), bias corrected (b) and Bias+RQI corrected (c) 
references. The positions of 10, 50 and 95 percentiles arc showed for each distribution. 
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Reference variogram PR variogram 



inSQftiistancB interdislance (Icm) 

Figure 7; Spatial variograms for reference (left) and PR (right) for the native (lop), bias 
corrected (middle) and Bias+RQI corrected (bottom) reference. The empirical variograms arc 
plotted with crosses, and the models fitted arc represented by the Uiick black lines. 
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Figure 6: Probability distributions of rain rates the PR rainfall and for the native (a), bias 
corrected (b) and Bia.s-i RQI corrected (c) reference rainfall. The solid and dashed-dotted lines 
represent the distribution by volume PDFv and the distribution by occurrence PDFc 
respectively, while the grey and black lines represent the distributions for references and PR 
respectively. Note that the x-axis is in log-scale. 
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Fig^e 8: ScaUerplols of PR versus native (a), bias corrected (b) and Bias+RQI corrected(c) 


reference rainfall The first bisectors (solid lines) are displayed. 
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Fig ure 11: Conditional bias (median) of residuals (left) and conditional random error 


(imerquantile 9()%-10%) of residuals (right) for PR as a timction of “Native” (dotted 
line), “Bias conecled” (dolled line) and “Bias+RQI corrected” references. 
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Reference [ mm.hr ' ] 

Figiue 10: Standard deviation of PR-reference residuals (dashed line), estimated standard 
deviation of the reference rainfall (dotted line) and standard deviation of PR - true rainfall 
residuals (solid line) as functions of the “Bias+RQI corrected” reference, Tlic vertical line 
(50 mm.h’’) indicates the limit of the good sampling conditions. 
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